Constructive and robust combination of perceptrons

We propose a new strategy for a constructive training of feedforward neural networks to classifit linearly nonseparable patterns. The algorithm results in a confguration of the first layer of the network, which is able to give a faithjtl internal representation of the input patterns. The weights of the network are obtained by the introduced CadaTron algorithm, which is able to separate clusters of data in a robust way. Iteratively, further neitrons are added to the nertral net in order to decrease the training error. Unnecessary neurons are removed, so this algorithm leads to a network with low complexity and excellent generalization properties. The results of this work are based on the classfleation of handwritten characters.